Predictability and control of extreme events in complex systems 
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In many complex systems, large events are believed to follow power-law, scale-free probability 
distributions, so that the extreme, catastrophic events are unpredictable. Here, we study coupled 
chaotic oscillators that display extreme events. The mechanism responsible for the rare, largest 
events makes them distinct and their distribution deviates from a power-law. Based on this mecha- 
nism identification, we show that it is possible to forecast in real time an impending extreme event. 
Once forecasted, we also show that extreme events can be suppressed by applying tiny perturbations 
to the system. 
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Extreme events are increasingly attracting the atten- 
tion of scientists and decision makers because of their im- 
pact on society [iH^ i which is exacerbated by our increas- 
ing global interconnectivity. Examples of extreme events 
include financial crises, environmental and industrial ac- 
cidents, epidemics and blackouts 0. From a scientific 
view point, extreme events are interesting because they 
often reveal underlying, often hidden, organizing princi- 
ples 0^ • In turn, these organizing principles may enable 
forecasting and control of extreme events. 

Some progress along these lines has emerged in studies 
of complex systems composed of many interacting en- 
tities. For example, it was found recently that complex 
systems with two or more stable states may undergo a bi- 
furcation causing a transition between these states that is 
associated with an extreme event [13] • Critical slowing 
down and / or increased variability of measureable system 
quantities near the bifurcation point open up the possi- 
bility of forecasting an impending event, as observed in 
laboratory-replicated populations of budding yeast . 

An open question is whether other underlying behav- 
iors cause extreme events. One possible scenario is when 
the system varies in time and is organized by attracting 
sets in phase space. For example, a recent model of finan- 
cial systems consisting of coupled, stochastically-driven, 
linear mappings [ll] shows so-called bubbling behavior, 
where a bubble - an extreme event - corresponds to a 
large temporary excursion of the system state away from 
a nominal value. In this example, the event-size distribu- 
tion follows a power-law, having "fat" tails that describe 
the significant likelihood of extreme events. One main 
characteristic of such distributions is that they are scale- 
free, which means that events of arbitrarily large sizes 



are caused by the same dynamical mechanisms govern- 
ing the occurrence of small- and intermediate-size events, 
leading to an impossibility of forecasting [l3l - [l7j |. 

In contrast, the new concept of "dragon-kings" (DKs) 
emphasizes that the most extreme events often do not 
belong to a scale-free distribution [l^. DKs are out- 
liers, which possess distinct formation mechanisms jl8| . 
Such specific underlying mechanisms open the possibility 
that DKs can be forecasted, allowing for suppression and 
control. Here, we show both power-law and DK-type 
statistics occurring in an electronic circuit that has an 
underlying time- varying dynamics identified to belong to 
a more general class of complex systems. Moreover, we 
identify the mechanism leading to the DKs and show that 
they can be forecasted in real time, and even suppressed 
by the application of tiny and occasional perturbations. 
The mechanism responsible for DKs in this specific sys- 
tem is attractor bubbling. As explained in what follows, 
we argue that it should be a generic mechanism appear- 
ing in extended coupled oscillators. 

The large class of spatially extended coupled oscilla- 
tors covers the physics of earthquakes JLQi] , biological sys- 
tems such as the collective phase synchronization in brain 
activity f20'|, and even of financial systems made of in- 
teracting investors with threshold decisions and herding 
tendencies (2l| . Most coupled-oscillator systems exhibit- 
ing chaos have multiple basins of attraction associated 
with invariant manifolds — subspaces of the entire phase 
space on which the system trajectory can reside [2^ . 
Generically, riddled basins are found in these coupled- 
oscillator systems [23|, |2J] , which means that a region of 
the basin of attraction for one attractor has neighbor- 
ing intermingled points ("holes") that connect to one or 
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more of the other attractors. These are only attractors 
in the weak sense in that trajectories from a finite, often 
complicated and structured, region of phase space even- 
tually make it to the attracting set [25|. Thus, riddled 
basins are always associated with weak attractors, which 
in turn are associated with attractor bubbling [26[. A 
bubble is a situation where the system trajectory irregu- 
larly and briefly leaves an invariant manifold as a result of 
occasional noise-induced jump from the dominating sta- 
ble attractor to a hole in the riddled basin that connects 
the trajectory to another attractor, eventually followed 
by reinjection to the dominating attractor in many sit- 
uations. In sum, attractor bubbling in riddled basins 
of attraction is a generic mechanism for DKs, which we 
conjecture apply to a large class of spatially extended 
deterministic and stochastic nonlinear systems. 

To highlight the connection between riddled basins, at- 
tractor bubbling, and DKs, we study two nearly identical 
unidirectionally-coupled chaotic electronic circuits in a 
master (mnemonic M) and slave (S) configuration. The 
state of each circuit is described by a three-dimensional 
(3D) vector whose components are related to the two 
voltages and the current of each circuit (see Fig. SI 
The temporal evolution of the state vectors is governed 
by the differential equations 

XM = F [xm] , (1) 
is = F [X5] + cK (XM - x,) , (2) 

where the dot over a variable means differentiation with 
respect to time, F [x] is the flow for each subsystem, c 
controls the interaction strength between the subsystems, 
and K is the coupling matrix. In general, the coupled 
system resides in a 6D phase space spanned by (xm,X5). 
However, for appropriate values of c and K, the coupled 
oscillators synchronize their behavior [23| . which corre- 
sponds to xm — X5. Hence, the coupled-system trajec- 
tory resides in a restricted 3D subspace (on an invariant 
manifold). In this case, it is insightful to introduce new 
3D state vectors that describe the behavior on the in- 
variant manifold X|| = (xm +xs) /2 and transverse to 
the manifold xj^ = (xm — X5) /2. Synchronization cor- 
responds to x^ = and X|| = xm, and the basin of 
attraction for the synchronized state is riddled. 

As discussed above, attractor bubbling occurs when 
noise is present (e.g., thermal noise in the electronic com- 
ponents) , when there is a slight parameter mismatch be- 
tween the oscillators (the flows of each circuit are slightly 
different), or when both effects are present, which is the 
most likely situation in an experiment. Bubbling is indi- 
cated by long excursions of high-quality synchronization 
(x_L close to the noise level) interspersed by brief desyn- 
chronization events where X|| takes on a large value — an 
extreme event — as shown in Fig.[lja). We illustrate the 
trajectory of a typical bubbling event in Fig. [IJb), which 
is a projection of the 6D phase space onto a 3D space 
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FIG. 1. (color online). Experimental observation of attrac- 
tor bubbling in coupled chaotic oscillators, (a) Typically ob- 
served temporal evolution of |xx| for c = 4.4 and Kij = 1 for 
i — j — 2 and otherwise. Time is measured in dimensionless 
units corresponding to tiie characteristic time in the circuit 
(see Supplemental Material), (b) Illustration of the system 
trajectory in the vicinity of a bubbling event. The 6D phase 
space is projected onto a 3D space, where the subscript on 
the axis label indicates the i*'^ component of the correspond- 
ing vector. The arrows indicate the direction of the flow and 
the colors indicate the height on the (xx)-^ direction. 

containing components of the invariant manifold and of 
the transverse manifold. It is seen that the trajectory 
remains for most of the time on the invariant manifold 
X|[ , but undergoes a large excursion away from the in- 
variant manifold during the bubbling event. Due to the 
nonlinear folding of the flow, the trajectory is reinjected 
to the invariant manifold after the bubble. 

To reveal the existence of DKs, we collect a long time 
series of values of |x_l|, use a peak-detecting algorithm 
to identify the bubbling events, and create a probabil- 
ity density function (PDF) for the event-sizes |x_l|„, de- 
flned as the largest peak- value of |xj^| within a burst. 
The resulting distribution is shown in Fig. [5J where it is 
seen that the event-sizes follow approximately a power- 
law distribution for small to moderately large sizes ( 
|x_l|„ < 1.7) with exponent — 2.0 ± 0.1. A substantial 
and signiflcant peak in the distribution and subsequent 
cut-off that deviates from the power-law is observed for 
the extremely large events ( |x_l|„ > 1.7), which we as- 
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FIG. 2. Appearance of dragon-kings. Bubble event-size prob- 
ability density function (PDF) for c — 4.4 and K,;j — 1 for 
i = j = 2 and otherwise. The dashed line is a fit to a power 
law with exponent —2.0 ± O.f. The dragon-kings correspond 
to the sharp peak at the high end of the distribution. 

sociate with dragon- kings. 

As discussed some time ago [1^, HI] , a bubbling event 
is initiated by "hot spots" within the chaotic attractor 
that resides on the invariant manifold. The attractor is 
composed of a large (likely infinite) number of unstable 
sets, such as unstable fixed points, unstable periodic or- 
bits, etc. [2^. Each of these sets has an associated local 
transverse Lyapunov exponent (28j . which describes the 
tendency of a trajectory to be attracted to or repelled 
from the invariant manifold when it is in a neighborhood 
of the set. A system with a riddled basin necessarily 
has a distribution of local Lyapunov exponents (see Fig. 
S2 ^27*1), where at least some are repelling (value greater 
than zero), even though their weighted average value is 
negative (attracting). The repelling sets correspond to 
the hot spots on the invariant manifold. 

For the coupled oscillators studied here, it was found 
previously that one set in particular — the unstable, 
saddle- type fixed point at xy =0 — is exceedingly trans- 
versely unstable and is the underlying originator of the 
largest bubbles [2^ Is^]. That is, there is a very high 
likelihood that a bubble will occur whenever xy resides 
in a neighborhood of the origin for some time, and the 
largest events (the DKs) occur when the residence time 
is long and the approach is close. The large bubble event 
shown in Fig. [ijb) clearly originates near xy = 0. Nu- 
merical calculations of a model for the system support 
the description above and ensuing results 

This observation allows us to predict the occurrence 
of a large event by real-time observation of xa/ , which is 
equal to xy when the subsystems are synchronized, and 
finding the times when it approaches the origin. Figure 
[3] shows the temporal evolution of |xm| and |x_l|, where 
it is seen that |xm| undergoes a sustained drop and re- 
mains below an empirically determined threshold value 
|xM|th preceding a large bubble (spike in |xj^|), where 
the forecasting time is denoted by tp. A smaller thresh- 
old is associated with a larger event size and hence it 



can be adjusted to isolate the DKs. Our observation, 
confirmed by numerical solution of Eqs. (Il])-(l2|), demon- 
strates that it is possible to forecast DKs in this relatively 
low-dimensional complex system. 
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FIG. 3. Forecasting dragon-kings. Temporal evolution of the 
trajectory projected onto the invariant manifold (|xAf|) and 
the transverse space (|xx|) during attractor bubbling (c = 
4.4 and Kij = 1 for i = j — 2 and otherwise). The largest, 
extreme event, which is part of the dragon-king distribution, 
is preceded by a long excursion of |xa/| below a threshold 
of |xjv_f|th ~ 0.50 whose value is determined empirically by 
minimizing the number of false predictions. 

With this scheme to forecast DKs, we design a feed- 
back method to suppress them based on occasional pro- 
portional feedback of tiny perturbations to the slave os- 
cillator when |xm| is below an empirically determined 
threshold [31]. In the presence of feedback, the temporal 
evolution of the slave oscillator (Eq. is modified to 
read 

X5 =F [xs] + cK (xA/ - X, ) + (3) 

[I - (]xa/] - ]xAf ]th)] CDK^DK (xAf - X^) , 

where 9 is the Heaviside step function, ]xAf]th is the 
threshold, and cdk {^dk) is the feedback strength (cou- 
pling matrix) used to suppress DKs. For the purpose of 
illustration, we assume that it is expensive or not conve- 
nient to keep this additional feedback coupling on all the 
time and thus it is only active for a brief interval when 
necessary. 

FigurelUa) shows the temporal evolution of the system 
in the presence of occasional feedback. When ]xAf] > 
lxA//]th7 no feedback is applied and the small bubbling 
events are allowed to proceed. On the other hand, when 
]xa/ ] < ]xA/]th, feedback perturbations are apphed that 
are only 3% of the system size (defined as the maximum 
value of ]xa/] ^ 4). Such small perturbation only causes 
a small change in X5 , yet it has a dramatic change in x^ : 
the large bubble is suppressed. Over a long time scale, 
feedback is only applied 1.5% of the time, consistent with 
the frequency and duration of extreme events. Thus, the 
total perturbation size averaged over the whole time, in- 
cluding the intervals when the perturbation is not ac- 
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FIG. 4. (color online). Slaying dragon-kings, (a) Temporal 
evolution of the trajectory projected onto the invariant mani- 
fold (|xm|) and the transverse space (|xx|) during suppressed 
attractor bubbling. When |xm| is below |xAf|th ~ 0.50 (the 
horizontal dashed line) the occasional feedback is activated, 
reducing the height of a bubble (in the time interval between 
the two vertical dashed lines) that would grow large other- 
wise, (b) Probability density function for event-size |xx|n in 
the presence (black) and absence (red online) of occasional 
proportional feedback. Here c — 4.4, cdk ~ 0.55, K^j — 1 
for i = j = 2 and otherwise, and (K_DK)jj ~ 1 for i — j — 1 
and otherwise. A more detailed comparison between exper- 
iment and theory is presented on the Supplemental Material 
0. 



tive, corresponds to 0.05% of the system size. As a result 
of this occasional feedback, we observe that the largest 
events, including the DKs, are entirely suppressed, as 
shown in the probability density function for |x^ | in Fig. 
m^b). It is seen that the small- to intermediate-size bub- 
bles are unaffected; only the events that would have a 
large size in the absence of control are suppressed. 

Our work addresses several important questions re- 
garding complex systems. We answer affirmatively and 
conclusively that: 1) a particular simple, but nontrivial 
system displays DKs whose event-size distribution devi- 



ates significantly upward from a power-law in the tail; 2) 
DKs can be predicted; and 3) this predictability can be 
used to occasionally and efficiently activate countermea- 
sures that suppress or mitigate the effects of DKs. An 
important and immediate open question is whether it is 
possible to easily identify the unstable sets that are pri- 
marily responsible for causing DKs in the wide variety of 
complex systems that are already known to have riddled 
basins and display attractor bubbling or in systems that 
may display bubbling but it is not yet appreciated that 
the behavior is of this type. Key to addressing this prob- 
lem is the development of new tools for analyzing models 
of complex systems or for time series analysis of natu- 
ral systems that can identify invariant manifolds (system 
evolution in a subspace) and the unstable sets that trig- 
ger DKs. We suggest that this is a worthy pursuit given 
the increasing appearance of extreme events and their 
impact on society. 
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